Digitartic: bi-manual gestural control of articulation in performative singing synthesis
نویسندگان
چکیده
Digitartic, a system for bi-manual gestural control of VowelConsonant-Vowel performative singing synthesis is presented. This system is an extension of a real-time gesture-controlled vowel singing instrument developed in the Max MSP language. In addition to pitch, vowels and voice strength controls, Digitartic is designed for gestural control of articulation parameters, including various places and manners of articulation. The phases of articulation between two phonemes are continuously controlled and can be driven in real time without noticeable delay, at any stage of the synthetic phoneme production. Thus, as in natural singing, very accurate rhythmic patterns are produced and adapted while playing with other musicians. The instrument features two (augmented) pen tablets for controlling voice production: one is dealing with the glottal source and vowels, the second one is dealing with consonant/vowel articulation. The results show very natural consonant and vowel synthesis. Virtual choral practice confirms the effectiveness of Digitartic as an expressive musical instrument.
منابع مشابه
Rule-Based Performative Synthesis of Sung Syllables
In this demonstration, the mapping and the gestural control strategy developed in the Digitartic are presented. Digitartic is a musical instrument able to control sung syllables. Performative rule-based synthesis allows for controlling semi-consonants, plosive, fricative and nasal consonants with a same gesture, despite the structural differences in natural production of such vocal segments. A ...
متن کاملEvaluation of Singing Synthesis: Methodology and Case Study with Concatenative and Performative Systems
The special session Singing Synthesis Challenge: Fill-In the Gap aims at comparative evaluation of singing synthesis systems. The task is to synthesize a new couplet for two popular songs. This paper address the methodology needed for quality assessment of singing synthesis systems and reports on a case study using 2 systems with a total of 6 different configurations. The two synthesis systems ...
متن کاملVokinesis: syllabic control points for performative singing synthesis
Performative control of voice is the process of real-time speech synthesis or modification by the means of hands or feet gestures. Vokinesis, a system for real-time rhythm and pitch modification and control of singing is presented. Pitch and vocal effort are controlled by a stylus on a graphic tablet. The concept of Syllabic Control Points (SCP) is introduced for timing and rhythm control. A ch...
متن کاملAdjusting the Frame: Biphasic Performative Control of Speech Rhythm
Performative time and pitch scaling is a new research paradigm for prosodic analysis by synthesis. In this paper, a system for real-time recorded speech time and pitch scaling by the means of hands or feet gestures is designed and evaluated. Pitch is controlled with the preferred hand, using a stylus on a graphic tablet. Time is controlled using rhythmic frames, or constriction gestures, define...
متن کاملBi-manual mapping experimentation, with angular fundamental frequency control and sound color navigation
In this paper, we describe a computer-based solo musical instrument for live performance. We have adapted a Wacom graphic tablet equipped with a stylus transducer and a game joystick to use them as a solo expressive instrument. We have used a formant-synthesis model that can produce a vowel-like singing voice. This instrument allows multidimensional expressive fundamental frequency control and ...
متن کامل